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(57) Abstract 

A method and apparatus are described for adaptively predistorting a signal before it is transmitted by a transmitter (12^ 14 .16. 18) in 
order to compensate for nonlinearities which are introduced. Statistical information regarding the received signal is accumulated at a receiver 
(24), and is preferably transmitted back to the transmitter for processing. The processing includes a constellation analysis to determine 
ihe distortio/characteristics of the signal, which may includes bias, gain imbalance, lock and quad angle ^^^^SS^ 
including AM-AM and AM-FM conversion effects, with all of these phenomena occurring anywhere in the ^ sm, " er ^ hann .™^ 
chain. From analysis of the statistics of the distortions in the received signal constellation, adjustments are made in the transmitter and/or 
receiver parameters. The positions of the signal symbols in the transmitted constellation are thereby correctively pred.storted to compensate 
for and ameliorate the distortions in the received signal, thereby improving the fidelity of the said received signal. 
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ADAPTIVE PREDISTORTION SYSTEM 
Field of The Invention 

The present invention generally relates to the field of data 
5 communications. More specifically, the present invention is for a method and apparatus 
for adaptively predistorting a signal before it is transmitted from a transmitter to a 
receiver of a communication system. 

BACKGROUND OF THE INVENTION 

10 Digital data communications systems are commonly used to transmit 

and/or receive data between remote transmitting and receiving locations. A central facet 
of any data communications system is the reliability and integrity of the data which is 
being communicated. Ideally, the data which is being transmitted from the transmitting 
location should be identical to the data which is being received at the receiving location. 

15 Practically however, the data which is received at the receiving location has oftentimes 
been corrupted with respect to the original data that was transmitted from the transmitting 
location. Such data communication errors may be attributed in part to one or more of the 
transmission equipment, the transmission medium or the receiving equipment. With 
respect to the transmission medium, these types of data errors are usually attributed to the 

20 less than ideal conditions associated with the particular transmission medium. 

For example, in the case of wireless communication systems, the 
transmission medium, which is typically air, often suffers from atmospheric and other 
effects that tend to degrade the data being transmitted. Some of these non-ideal 
conditions may be modeled and taken into account in order to compensate for and thereby 

25 reduce or possibly eliminate any deleterious effects resulting therefrom. In this respect, it 

1 
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is generally known that signal attenuation is a function of the distance that the data signal 
must propagate through the atmosphere. Thus, it is possible to design a wireless 
communications system which is capable of transmitting a data signal sufficiently robust 
such that in spite of known distance-dependent atmospheric attenuation, the data signals 
at the receiving location can be properly and accurately received. Other types of non- 
.deaht.es associated with an air or atmospheric transmission medium are often highly 
random events which may not be modeled a priori and thus may not be compensated for 
or eliminated. 

The transmission of data over interconnecting wires also suffers from 
several noise and attenuation phenomena. For example, wires exhibit frequency 
dependent attenuation characteristics. Additionally, wires are subject to thermal or other 
types of noise. 

To overcome these problems, data communications systems often rely on 
error detection and error correction schemes, to detect the occurrence of a data error and 
to correct a data error, respectively. One simple form of error detection is the use of a 
parity bit associated with each block of data to indicate whether the particular block 
contains an odd or even number of 1 bits. However, this is a very simple scheme which 
has numerous disadvantages. It is a simple type of error detection scheme which is 
capable of accurately detecting up to one bit error per data block. Moreover, the use of a 
parity bit cannot detect the occurrence of two bit errors in a data block, since this is not 
even detected as a parity violation. Additionally, the use of a parity bit only detects 
errors; it cannot correct errors. Any time that an error is detected, the receiving location 
typically requests retransmission of the particular data block from the transmitting 
location. 6 

One type of error correction scheme commonly used in data 
communications systems is the use of redundant data transmissions and a voting circuit at 
the receiving location. In such a system, the data being transmitted is repeated a number 
of times, such as five. At the receiving location, all five data blocks are received and 
processed by a voting circuit which compares the five received versions of each data bit 
and determines the bit to be a 1 or 0 based on the voting consensus. Although such a 
system is capable of detecting and correcting data errors, it does so at a great cost in terms 
of the effective data throughput or transmission rate. This is due to the fact that each data 
block must be repeated a number of times. 
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Another type of error correcting scheme is the use of encoded data, such as 
trellis coded modulation (TCM). Trellis coded modulation involves the use of forward 
error correction in a transmitter and corresponding decoding in a receiver to correct data 
errors which occur during transmission. The signal transmitted by the transmitter 

5 includes some form of memory or history so that a current signal is dependent on 
previous signals. This is achieved by limiting the choices for a next possible signal based 
on the current and previous signals. In this way, by knowing a sequence of previously 
received signals, the receiver obtains some assistance in determining the authenticity of a 
currently received signal. At the receiver, the sequence information of the received 

10 signals is used to select a next signal most likely to have been transmitted. Both the 
transmitter and receiver know the predetermined, limited choices for a next signal based 
on the previous signals. Thus, even if a signal gets corrupted during transmission, the 
receiver may be able to still identify the correct, intended signal. One type of TCM 
method is disclosed in U.S. Patent No. 4,980,897 to Decker et al., entitled MULTI- 

15 CHANNEL TRELLIS ENCODER/DECODER, the contents of which are incorporated 
herein by reference. 

The above-mentioned correction/detection schemes are examples of binary 
block codes. Specifically, an (n,k,d) binary block code is a set of 2 k binary codewords of 
block length n and minimum distance d (i.e., coding distance). The transmitted data is 

20 partitioned into binary blocks of length k, then each block is mapped into a binary 
codeword of length n, which is then modulated and transmitted through the channel. This 
block code is capable of correcting up to t = (d-l)/2 errors within each codeword. 

Different types of data transmission formats are susceptible to different 
types of attenuation and distortion. Narrowband transmission formats such as frequency 

25 shift keying (FSK) or amplitude shift keying (ASK) are somewhat immune to frequency 
dependent attenuation, and thus may suffer little or no distortion. However, the entire 
band of the narrowband signal may fall into an attenuation null and be severely 
attenuated. Wideband transmission formats such as spread spectrum are less susceptible 
to the signal degradation caused by a narrowband attenuation null. However, due to the 

30 wider bandwidth associated with a spread spectrum signal, the spread spectrum signal 
experiences more distortion due to frequency dependent attenuation. Thus, a 
conventional narrowband signaling format is susceptible to attenuation while a 
conventional wideband signaling format is susceptible to distortion. 
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Another type of signal enhancing approach is to compensate, by 
approbate filtering of the received signal, for errors due to frequency dependent 
difference. ,n attenuation, time delay, or both, introduced by either the transmitter the 
transmission medium and/or the receiver. In this way, the deleterious effects such as 
mtersymbol interference which causes bit errors, are eliminated and the received signal is 
restored to its original level and quality. This approach is generally referred to as 
equalization. 

In most practical cases, the channel characteristics are unknown and may 
vary with Ume. Hence, the equalizer must be updated with each new channel connection 
as m the case of a voice-band modem operating in a switched network, and must also 
adapt the filter settings automatically to track changes in the channel with time. There are 
two general types of equalizers. In preset equalizers, a training sequence of data bits is 
transmuted and compared at the receiver with a locally generated sequence The 
resulting error voltages are used to adjust the equalizer filter tap gains to optimum 
settings (which result in minimum distortion). I„ adaptive equalizers, the tap gain 
adjustments are derived directly from the transmitted data bits via decision directed 
feedback of the equalizer output errors, to minimize these output errors. 

In one form of preset equalization, using a training sequence which is 
repeatedly transmitted from the transmitter to the receiver by way of the distorting 
communication channel, a set of parameters is established and used to emulate the effects 
of the distorting communication channel. Such a system is disclosed in U.S. Patent No 

v^T™ ° hOW ^ entiUed METH ° D F ° R EQUALS A MULTICARRIER 
SIGNAL IN A MULTICARRIER COMMUNICATION SYSTEM, the contents of which 
are incorporated herein by reference. The disclosed process is an iterative process which 
»s repeated until a predetermined convergence condition is met. Convergence is 
determined by comparing the equalized received signal (using the estimated parameters) 
with a local replica (at the receiver) of the training sequence. 

An alternative to equalization is predistortion, in which the distortive 
characteristics of the transmitter and/or channel are measured, and opposite 
compensating distortions are introduced into the data entering the transmitter, so that the 
net effect at the receiver is a signal that has no net distortions, thereby eliminating the 
message errors introduced by the naturally occurring distortions. 

In digital communication systems, such as radio systems, a major source 
of s,gnal degradation or nonlinear distortion is the high power amplifier (HPA) used at 
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the transmitter. Most high power amplifiers generally have a linear operating region (at 
low power) which progresses into a nonlinear region (at higher output power). In most 
communication systems, in order to compensate for the losses and attenuation associated 
with the transmission medium, the transmitter is operated at a higher power level. 

5 However, operating at the higher power level introduces nonlinearities associated with 
the amplifier. One approach to eliminating the nonlinearities at higher power levels is to 
use a higher power amplifier; however, this results in a more complex and costly circuit 
design. Additionally, a higher power amplifier consumes more power, generates more 
heat and radio frequency interference (RFI), and occupies more circuit board space. In 

10 order to use the nonlinear operating region of the amplifier, and thus avoid the need for a 
higher power amplifier, some type of predistortion is used to compensate for the 
nonlinear effects introduced by the amplifier. One such approach is presented in Georges 
Karam and Hikmet Sari, "A Data Predistortion Technique with Memory for QAM Radio 
Systems", IEEE Transactions on Communications . Vol. 39, No. 2, February 1991, the 

15 contents of which are incorporated by reference herein. 

Karam and Sari describe a technique for predistorting the in-phase and 
quadrature components of the location of each quadrature amplitude modulated (QAM) 
data symbol that is input to a nonlinear power amplifier in order to compensate for the 
warping of the constellation by the nonlinearity, and also to compensate for the spreading 

20 of the transmitted symbols into a dispersed cluster at each ideal constellation point, 
caused by intersymbol interference due to filtering of each transmitted symbol within the 
transmitter. This filtering causes the apparent constellation coordinates of each symbol to 
be somewhat varied by the values of preceding and following symbols. Since the input 
amplitude of each pulse is thereby altered, the amount of nonlinear distortion for pulses at 

25 any ideal symbol point also varies with the values of the preceding and following 
symbols. If each symbol in an M-point constellation is considered to be affected by L 
preceding and L following symbols, i.e., by K = 2L + 1 symbols including itself, then 
each constellation point may take on M K "' different predistorted values. A memory must 
be provided to store the required predistortion for each of these values. Since the size of 

30 this memory becomes impractically large for large constellations, Karam and Sari 
recommend a technique in which quadrant symmetry and partitioning of the ideal symbol 
points into groups are used to reduce the total memory requirement. They show that 
significant predistortion processing gain can be achieved for up to 256-QAM (and 
possibly higher) modulations with reasonable memory requirements. 

5 
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Although Karam and Sari's technique functions to compensate for 
transrmtter nonlinearities, inciuding both AM-AM (amplitude input distortions cause 
amplitude output distortions) and AM-PM (amplitude input distortions cause phase 
output dromons) conversion, it does not at a,, address the many types of distortions that 
can occur m the transmission channel and the receiver, many of which are time-varying 
nd all of wh.ch can affect the output symbol error rate. These distortions include offset 
biases, in-phase/quadrature gain mismatches, lock angle errors, quad angle errors 
nonlmear distortions, phase noise, multipath, interference, and crosstalk 

There are two other limitations of the Karam-Sari technique described 

TZ* teChniqUe PreSUmeS ^ n ° nlinear gai " and P hase characteristics of 

the HPA remain invariant, so they can be measured and modeled initially, and then the 
measured scaling coefficients can be stored in memory to be used to appropriately 
pred,stort the input data. In practice, HPA nonlinearity curves can change with time, due 
to the effects of component aging, voltage changes, and temperature and other 
env.ronmental variations. Therefore, it is necessary to periodically check and recalibrate 
the HPA nonhneanty parameters. While this is possible at the originating transmitter it 
is much more difficult, if not impossible, at remote repeaters and satellite transponders 

The second limitation of the Karam-Sari technique is that it requires 
knowledge of the m-phase and quadrature amplitudes of the symbols in the data stream at 
the mput to the predistorter preceding the HPA. While this information is readily 
available at the originating transmitter, it is not so readily available at intermediate 
repeaters and transponders. There, the signals must first be demodulated and the in-phase 
and quadrature amplitudes of the symbols must be measured for input to the predistorter 
memory. The predistorted signals must then be remodulated for input to the HPA These 
steps can add a significant penalty in added equipment size, weight, power, and cost 
especially in the case of satellite transponders. 

Summary of the Invention 

The present invention provides an improved method and apparatus for 
adaptively predistorting a signal before it is transmitted. The adaptive prediction of the 
present invention is accomplished at reduced complexity and cost, and is thus especially 
valuable m situations where the complexity and cost of the receiver must be kept as low 
as possible. The adaptive predistortion compensates for voltage offsets (biases) gain 
m.smatches, lock and quad angle errors, and channel and receiver nonlinearities 
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Multipath and frequency-dispersive channel effects may be compensated for by using an 
adaptive equalizer following the receiver. In some systems, interference and crosstalk 
may be minimized by tuning the transmitter to carrier frequencies where these 
phenomena are minimized. 
5 According to the present invention, the receiver accumulates certain 

statistics regarding the data sample values in each received symbol cluster in the signal's 
amplitude-phase constellation. These statistics are then sent via a low data rate reverse 
control channel to a processor at the transmitter where control parameters and symbol 
predistortion values are calculated. Distortion phenomena controllable by predistortion 
10 are then corrected in an adaptive predistorter following a memory-based predistorter at 
the transmitter. For phenomena that are most easily corrected at the receiver, the control 
parameters, which were computed using a data processor at the transmitter (to lower 
receiver cost), are sent to the receiver over a low data rate forward control channel. 
Alternatively, the calculations on the statistical information accumulated at the receiver 
15 may be carried out at the receiver itself. 

Information is expressed digitally in bits (0s and Is in the binary number 
system). The rate R at which bits can be transmitted over a channel of a given bandwidth 
W is constrained by Shannon's channel capacity theorem. By using multiple signal 
phases and amplitudes for transmitting k information bits per symbol (per waveform), the 
20 bandwidth efficiency RAV is increased in proportion to k = log 2 M, where M is the 
number of distinct symbols in a given coordinate. A two-dimensional constellation of 
unique symbols, each representing a unique sequence of bits, may be formed by 
quadrature amplitude modulation (QAM), in which waveforms with two orthogonal 
phases (denoted in-phase and quadrature) are assigned one of M possible amplitudes in 
25 each coordinate. M is usually taken as a power of two, and the symbol amplitudes in 
each coordinate are usually equally spaced and symmetric about the origin. If M is an 
even power of two, we obtain a square QAM constellation. If M is an odd power of two 
and some corner symbol positions are eliminated, we obtain what is called a cross QAM 
constellation. For quadrature partial response (QPR) coding, M is not a power of two, but 
30 is instead an odd integer. The constellations used in carrierless AM/PM (CAP) 
modulation look like those of the modulation schemes discussed above, however, they are 
formed at baseband without modulation onto a carrier wave. The invention described 
herein can be applied to all these types of signals. With minor modifications, the present 
invention can also be applied to circular phase-shift keyed constellations and other 

7 
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constellations with Sym bols arranged on a non-square grid, and extensions to these 
constellation types are incorporated within the scope of this invention. 

A demodulator is used to determine which symbol was transmitted by 
d.v lding the constellation region into cells with boundaries equally spaced between 
adjacent .deal symbol locations. Comparison of the coordinates of the received symbol 
wuh the eel, boundaries identifies the received symbol. The receiver then translates the 
identified symbol mto the corresponding bit sequence associated with that symbol 
No.se intersymbol interference (ISI), and multipath will cause the positions of the 
rece, vea symbols to be smeared into dispersed clusters centered on the ideal coordinates 
of the transmuted symbols. Other impairments, such as biases, gain imbalances, lock and 
quad angle errors, and nonlinear effects, will shift the centers of the received symbol 
clusters from their ideal locations in predictable manners. If the position of a received 
symbol 1S shifted away from its ideal location, due to any of these effects, by more than 
the stance to the nearest cell boundary in the direction of shift, then the receiver will 
determine the symbol to be in other than the correct cell. The symbol will then be 
rnisidentified and the transmitted bit stream will be incorrectly decoded. It is the purpose 
of this invention to assure that distortions of the constellation, which can shift the 
received symbols relative to the receiver's decision boundaries, are minimized, thereby 
mmimxzing the decoded bit error rate (BER). Of course, purely random noise effects are 
not thereby mitigated and still set a limit on the minimum achievable BER. 

The analysis of the received signal is performed using constellation 
analysis (d 1S cussed in detail below). The constellation analysis is performed on statistical 
data concerning the received signal, which is measured at the receiver. The constellation 
analysis, which may be performed at either the transmitter or the receiver, yields the 
distortion characteristics of the received signal. This information is then provided to the 
transmitter in order for the transmitter to appropriately compensate the outgoing signal 
before it is transmitted. It is generally more advantageous to compensate the signal at the 
transmitter, rather than at the receiver, because by the time the signal is received at the 
receiver, the signal may not be recoverable. Although the calculations may be performed 
at either the transmitter or the reciever, when minimizing the cost of the receiver is 
•mportant, it is better to process the statistical data for the constellation analysis at the 
transmitter. Nevertheless, distortions that are due to misadjustments of the receiver can 
best be corrected by sending readjustment commands to the receiver to correct the 
receiver parameters that are causing these distortions. 
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The present invention will become more apparent from the following Brief 
Description of the Drawings and Description of Preferred Embodiments. 
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invention. 



brief Description of the Drawings 

Figure 1 is a block diagram of the predistortion system of the present 

Figures 2a, 2b, and 2c are illustrations of various modulation schemes 
Figure 3a is an illustration of the effects of positive lock angle error ' 
Figure 3b is an illustration of the effects of negative lock angle error 
Figure 4a is an illustration of the effects of positive quad angle error' 
Figure 4b is an illustration of the effects of negative quad angle error 
F lg ure 5 is an illustration of the effects of combined lock angle error auad 
angle error, and gain mismatch. g ' qUad 

Figure 6 is a block diagram of an alternative embodiment of the 

aCiT 0 r m °: the present invention ' whkh " ~ « t 

mod* H 3 " Umber ° f tranSmiUer P — ' rather ^an individually 

modifymg the location in the constellation of each transmitted symbol 

into a set of sTI 4 oT uT" * "* ***** of co "^^ion decomposition 
into a set of simple 4-QAM subconstellations, each of which can be individually 
predistorted in a quasi-linear manner. individually 

Description of Preferred Embodiments 

oreH" , Referring "° W t0 FigUrC th6rein is shown a blo <* diagram of the 

pred stortion system of the present invention. The symbol source, or modulato 2 
supplies the data to be transmitted. This data may be in QAM or any other o ^ he above 
mentioned formats. The modulated symbol stream is first input to a P r^sZTZ 
memory 14, which may be implemented in accordance with the teachings of Zl ^ 
San .cussed above. The data output from the predistorter with memory 14 s 7e n 
input to an adaptive predistorter 16. The output of the adaptive predistorter 16 is th n 
-put to a power amplifier 18. The predistorter with memor 14 is general y use 
Power amplifier is operated in a nonlinear mode, in which case it functions to co^l 

zz: r Tz:?v f the power ampnfier ,s - in the - ° f • -^earU: 

amplifier 18, then from time to t.me a test sequence of symbols is sent directly to the 
Power amphfier 18, bypassing the adaptive predistorter ,6 by means of sw c 20 T 
test sequence must be re-sent at a rate comparable with the rate at which the gam of the 
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power amplifier changes due to temperature or voltage variations. The test sequence can 
either be sent as a continuous symbol stream that occasionally interrupts the data stream, 
or preferably as selected symbols that are part of the overhead bits that accompany each 
frame of data. The frequency at which the test sequence is utilized depends upon the 
5 particular operating environment. These test symbols are extracted from the power 
amplifier output, their normalized distance from the origin of the symbol constellation is 
measured, and the measurements are used to readjust the symbol position mapping in the 
memory of the predistorter. Alternatively, the adaptive predistorter 16 may be used to 
compensate for the nonlinear operation of the power amplifier 18. 
0 From the power amplifier 18, the signal propagates through the forward 

transmission channel 22 to the receiver 24. At the receiver 24, the statistics regarding the 
positions, sizes, and shapes of the symbol clusters are measured on a periodic basis, and 
are sent via the reverse control channel 26 to the parameter processor computer 28 at the 
transmitter. The statistics are measured at the receiver 24 because transmitting the raw 
5 in-phase and quadrature (I-Q) measurements on all symbols used in the statistical analysis 
over the narrowband reverse control channel would greatly exceed the capacity of that 
channel. Generally, the distortion on the reverse control channel is significantly less than 
that on the forward channel and does not affect the transmission of the statistical 
information. The processor 28 calculates the parameters of the constellation distortions 
20 that arise in the forward channel and receiver. These parameters are used to adjust the I- 
Q coordinates of the transmitted symbols in the adaptive predistorter 16 so as to minimize 
the resulting received distortions. For some types of distortions, such as linear 
constellation offsets due to voltage biases in the receiver or gain imbalances (giving 
unequal scales in the I and Q coordinates) in the receiver, the values of the corrective 
25 voltages may be sent to the receiver 24 in the overhead bits on the forward transmission 
channel 22 to reduce the effects of these constellation offsets and gain imbalances. 
Finally, an adaptive equalizer 30 mitigates the effects of multipath propagation and 
frequency dependent (dispersive) phenomena, such as Rayleigh fading, over the forward 
transmission channel 22. The corrected symbol data then goes to the demodulator 32 
30 where the information bit stream is extracted. 

Referring now to Figures 2a, 2b and 2c, therein are illustrated the 
configurations of 16-QAM (quadrature amplitude modulation), 32-Cross QAM, and 25- 
QPR (quadrature partial response) symbol constellations. For the QAM and QPR 
constellations, the states are numbered in the x and y directions as i = 1,2,..., and j = 

11 
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1.2 respectively, beginning i„ the lowcr left . hand corner 
censed coordinate system, the constellation point (g) ^ 'J 
coordinates (^,^) = (/J), where 



2 ' / -- / — 0) 



A/ + 1 



wherer M is ,he number of symbols in each coordinffle ^ ^ ^ ^ 

conflation of Figure 2a, M = 4, and fori = , 4 we have /= -3/2, -1/2 1/2 and 3/2 

For ease of notation, the following expression will be used: 



<* = (M + l)/2. (2) 



Due to various system impairments, the actual centers of the observed 
m oment clusters wi., not faH exactly on the idea, state locations in the 
Plot. However, tt ,s assumed thai the locations of the cluster centers can be ft. to a pat of 
coupled nonlinear polynomials in i and j, as follows: * 



* e = A, + BJi - d) + B v (j - d ) + cjf _ df + CJj _ df + DJ . _ d) , + _ df 

(3a) 

% = A, + B> , (/ - „ + ^ _ + c _ ( ,. _ ^ + ^ _ df +DJ ._ d) , + DJ . _ df 

(3b) 

Here ' a " d "» ,he estimated model coordinates for the center of 
- cluster (.J). Al and A y ate constants which represent the constellation offsets in the x and 
y d.rec,,o„ S , respecnvely. B„ and B yy are the linear gains, or column and row spacings 



especvcly ,e„ the ftrs, order change in the x and , directions,, B „ is the linear run pe, 
unit „se, or horizontal skew, in the column position as a function of row (i e the first 
order change in the x d.rection „ a function of the y coordinate value a, ma, poim, B 
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is the linear rise per unit run, or vertical skew, in the row position as a function of column 
(i.e., the first order change in the y direction as a function of the x coordinate value at that 
point). C xx , C yy , D xx , and D yy are the corresponding nonlinear gains, or variations in the 
column and row spacings. Specifically, C xx is the second order change in the x direction; 
C yy is the second order change in the y direction; D xx is the third order change in the x 
direction; and D yy is the third order change in the y direction. Similarly, C xy , C yx , D xy , 
and D yx are the corresponding nonlinear (second and third order) skews in the column 
and row positions. In the ideal undistorted case, B xx = B yy = h and all other model 

are zero. To obtain jL and y.., we must use the sets {x ijk } and {y ijk } (where k 
parameters y IJ 

denotes the individual symbols within each cluster) to estimate the parameters A x , B^, ... 

The problem of estimating the parameters of the equations that provide a 
best least-squares fit to the available data samples (measured constellation points in phase 
space) is one of multiple linear regression, since the estimates depend linearly on the 
parameters. The standard statistical procedure for estimating such parameters from an 
overdetermined set of data (i.e., there are more data samples than parameters) is to set up 
and solve the so-called "normal equations" for least squares estimation (see, e.g., N.R. 
Draper and H. Smith, Applied Regression Analysis , John Wiley & Sons, Inc., 1966 which 
is incorporated by reference herein). 

Matrix notation will be used to set up and solve the corresponding normal 
equations for the parameters in Equations (3). The parameter matrices P x and P y and the 
matrix of coefficients Cij for cluster (i,j) are defined as follows: 



and 



Pi = 


K 


B xx 




c xy A« 






(4a) 




K 




Byy Cyx 


Cyy D yx D yy \ f 






(4b) 


{i-d\ 


u- 




{i-d)\ 


(j-d){ (i-d)] 


u 


-*i 


















• (5) 




o- 




('-< 




u- 


-< 
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The prime (') here denotes the matrix transpose. Also, the matrices, D 
and Dy< , the matrices of , and , coordinates of all symbols in the ft ,> th Custer, a „ d 
error matrices, E K< and , for cluster (i j) are defined as 



10 



15 



and 



y v 



(6) 



E = 

















E v = 
y.j 

















(7) 



I. shou.d be noted that there are KlJ data samples in cluster (ij), and that there are K 
identical elements in each column of C y . u 



Since the parameters A x , B xy , ... are dependent upon the data samples in all 
clusters the observations of all clusters are combined in estimating these parameters. The 
compete coefficient, data, and error matrices C, D x , D y , E x , and E y for the entire 
constellation are defined as the following partitioned matrices 



20 



and 



C = 



D„ = 



E = 



'MM 



D. 



D 



Jmm 



E. 



E 



y mm 



(8) 



(9) 



(10) 
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The model equations (3) may now be written in matrix form as 

D X =CP X +E X , (11a) 
D y =CP y +E y . (lib) 

The normal equations for estimating the parameter matrices P x and P y are given by 

CCP X =CD X , (12a) 
CCP y =C'D y , (12b) 

where the prime (') indicates the matrix transpose. The solution of these equations yields 

P x = (CC)~'C'D X , (13a) 
P y =(C'C)" , C'D y , (13b) 

where denotes the inverse of a matrix. The following relationships are also defined: 

A = C'C, (14) 

20 B X =C'D X , (15a) 

B y =C'D y . (15b) 

Equations (13) then become 

25 P X =A-*B X , (16a) 

P y =A- , B y . (16b) 

The above analysis is similar to that of McKissock (M.J. McKissock, 
"Constellation Measurement: A Tool for Evaluating Digital Radio," Hewlett-Packard 
30 Journal . July 1987, the contents of which are incorporated herein by reference). 
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Using Equations (8) and (5) in (14), and defining /,.=/- d and m . = , d 
the following result is obtained: ' 



M M K ij 



1 


hk 


hk 


4 


m jk 




4 


/ 3 

Hk 


m )k 


l ik m jk 


/ 3 


hk 


m )k 


l ik m jk 



hk m jk 
m % 

,2 

hk^jk 
m jk 

hk m jk 
m jk 



Hk 

4 m ,* 



Hk 
hk 



l ik m 



■jk 



m jk 

2 
jk 

3 



l ik m \ 



m 



h\™)k 

m jk 
;3 2 
Hk m jk 



m 



It should be noted that since each term in (17) is summed 



/ 3 
hk 

z 4 

l ik 
l ik m 



Jk 



Hk 



'ik™jk 



ik 



'jk kkm-jk 



m 



jk 
l ik m )k 
m jk 

m jk 

hWjk 



m 



jk 



(17) 



over the same range in i, in j, 



10 



and in k, A remains a 7x7 matrix. 

Similarly, using Equations (6) and (8) in (15a) and (15b) results i 



M M K ij 



and 



x ijk 

hk x ijk 

m jk x ijk 
Hk x ijk 

m jk x ijk 
l ik x ijk 

m jk x ijk 



(18) 
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M M *tf 
i*l >=] Jt=i 



m 



(19) 



Again, since each term in equations (18) and (19) is summed over the same range in i, in 
j, and in k, B x and By remain 1x7 matrices. 

In the invention, the parameter matrices P x and P y are obtained by 
inserting Equations (17), (18), and (19) into (16a) and (16b), and evaluating the results 
with the actual data coordinate values Xjjfc and y^. This gives the coefficients in 
Equations (3). The components of P x and P y , as given by Equations (4), are then 
inserted into Equations (3) to evaluate the bestrfit model coordinates, (x, y ,y..), of each 
cluster in the constellation. 

The x and y offsets of the actual measured constellation from the center of 
the ideal constellation plot (x = 0,y = 0) are equal to A x and A y , respectively. If there 
are no rotational or quadrature distortions (lock angle error, quad angle error, AM-PM 
conversion nonlinearity) of the constellation, then the x and y offsets in the I and Q 
directions are the only constellation offsets. If the estimated x and y offsets, A x and A y 
are not zero, commands are sent to the receiver 24 to adjust bias voltages to shift the 
constellation by amounts -A x and -Ay, i.e., to shift the constellation back to center. 
Alternatively, all transmitted symbols may be pre-shifted by amounts -A x and -A y at the 
transmitter to accomplish the same effect. In general, since translational offsets in the 
constellation (A x and Ay ) are typically due to misadjustments in the reciever, it is better 
to correct for such receiver errors at their source, within the receiver 24. However, if it is 
essential to obtain a receiver 24 with minimum complexity and minimum cost, it may be 
better to forego adjustability in the receiver 24, and instead predistort the symbols coming 
out of the transmitter so as to compensate for the uncorrectable errors in the receiver 24. 

The linear gain ratio between the x and y coordinates is 
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Rg-B^/B^,. ( 20) 
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Again, in the absence of rotational and quadrature distortions, this gain ratio is equal to 
the net linear I-Q gain mismatch of the modulator (transmitter) and demodulator 
(receiver). In the presence of rotational or quadrature distortions, the I-Q gain mismatch is 
not so simply related to the x-y gain ratio. If the gain imbalance is assumed to be all in 
the receiver 24 (i.e., no distortions are assumed to be introduced by the transmitter and 
the forward transmission channel 22) and R G > 1, then a command may be sent to the 
receiver 24 to either decrease the in-phase gain by a factor of R c> or increase the 
quadrature gain by the same factor. If R G < 1 then a command may be sent to the receiver 
24 to either increase the in-phase gain by a factor of R G , or decrease the quadrature gain 
by the same factor. 

It should be noted that this gain ratio Rq is defined to depend upon only 
the linear terms in Equations (3). B xx and B yy are the spacings between adjacent columns 
and rows, respectively, in the constellation, assuming that all columns and rows are 
uniformly spaced (negligible nonlinearities C xx , D xx , etc.). If the nonlinear terms are non- 
negligible, the column and row spacing will be a function of amplitude. In that case, the 
second and third order gain ratios may be defined as follows: 

R C2=C XI fC }7 , (21) 

and 

R G3 = D„ I D yy . (22) 

However, if the C and D terms are non-negligible, this indicates that there are additional 
nonlinearities in the forward transmission channel 22 and/or receiver 24 that were not 
corrected by the memory based predistorter 14. In that case, it may be better to readjust 
the coordinates of the transmitted symbols at the transmitter, using the adaptive 
predistorter 16. If > 1, then either C xx is decreased by a factor of Z?^, or C yy is 
increased by the same factor. Similarly, if R^ > 1, then either D xx is decreased by a 
factor of R G3 , or D yy is increased by the same factor. 
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Lock angle error measures the angle of rotation of the constellation 
relative to its ideal position. This type of error arises from factors such as carrier- 
recovery phase-lock loop misadjustment (demodulator not correctly phased with the 
incoming signal) or interfering tones upsetting the carrier recovery loop. 
5 Figures 3a and 3b are illustrations of lock angle error in the presence of a 

gain mismatch for the simple case of QPSK (i.e., 4-QAM) modulation. The angle of 

phase rotation (the lock angle error) 0 is here defined as positive in the clockwise 
direction. Figure 3a shows the geometry for positive 0, and Figure 3b shows the 

geometry for negative 0. B xx is the measured spacing between columns of constant I 

10 coordinate, as projected upon the x axis. B yy is the measured spacing between rows of 
constant Q coordinate, as projected upon the y axis. B xx is measured positive to the right, 
and B yy is measured positive upward. B xy is the linear run per unit rise measured 
between successive rows of clusters. B yx is the linear rise per unit run measured between 
successive columns of clusters. It should be noted that B xy is measured positive to the 

15 right in going from a lower to an upper row. Similarly, B yx is measured positive upward 
in going from a left to a right-hand column. These conventions are established to provide 
consistency in equations and results for all possible combinations of lock and quad angle 
errors. 

Other angles shown in Figures 3a and 3b include a, the angle from the 

20 rightmost cluster in the rotated constellation to the positive x axis, and £, the angle 
between the diagonals of the rotated constellation, measured between the right hand 
clusters having a common I coordinate, and originating at the rightmost cluster. y/ x and y/ y 

are defined as y/ x = -tan^B^/Z?^) and y/ y = tan -1 ^^/^). The lock angle error is 
then given as 



25 



e = I 



t R ft ^ 

mn -l£2L_ tan -'**L 

V B yy B xxj 



(23) 



It should be noted that by the sign definitions for the B mn defined above, for positive lock 
angle error B yx is negative and all other B mn are positive. Therefore, both terms in 
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Equation (23) are positive, leading to 9 > 0, as expected. Similarly, for negative lock 
angle error, B xy is negative and all other B mn are positive. Therefore, both terms in 
Equation (23) are negative, leading to 6 < 0. In the absence of any lock angle error, 6=0, 
so that Equation (23) leads to 

B xy/B yy =B yx /B xx . t - ^4) 

Even if 6 = 0, B xy and B yx can be non-zero. This is the case when there is 
quad angle error (discussed in detail below) but no lock angle error. When there are 
neither lock angle nor quad angle errors, then B xy = B yx ■ 0. 

A useful alternative expression for the lock angle error can be obtained 
from the angles in Figures 3a and 3b. Noting that the constellation is symmetric about its 
axes (either with or without lock angle rotation), these figures shows that 

15 e ~2~ a ' ( 25 > 

Recalling that angles are defined positive clockwise, Figure 3a shows that for positive 
lock angle error, <T>0, a>O,and0>O. Similarly, Figure 3b shows that for negative 
lock angle error, £ < 0 , a < 0 , and 0 < 0 . £ and a can be obtained in terms of the B mn , 

20 leading to an expression for 6 in terms of the B mn . Equation (23) is valid for the case of 
no quad angle error. It is also valid for the case of quad angle error with no lock angle 
error, in which case Equation (24) holds and 6 = 0. However, when lock angle and quad 
angle errors are both present, Equation (23) may not give the correct result. Equation 
(25), wh,ch u more general, should then be used. An expression for (25) in terms of the 

25 Bmn will be given below. 

Quad angle error measures the degree of departure of the I and Q 
coordinates of the modulator and demodulator from orthogonality in the x-y plane 
md.cating that the two modulator or demodulator branches are not strictly in phase 
quadrature. As a result, the output of the threshold decision slicer in one coordinate at the 
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demodulator will depend on the value of the other coordinate as well, leading to decision 
errors in determining which symbol was actually transmitted. Essentially, when quad 
angle error is present, the constellation is "stretched" along one diagonal direction and 
compressed along the other diagonal direction. In contrast, lock angle error results in a 

5 fixed rotation of the entire constellation, without "stretching". 

Figures 4a and 4b are illustrations of quad angle error in the presence of a 
gain mismatch, but no lock angle rotation, in the simple case of QPSK modulation. 
Again, all results in this section will apply equally well to all QAM and QPR modulations 
of any order. The coordinate gains B xx and B yy and the skews B xy and B yx are defined 

10 with the same sign conventions as noted previously for Figures 3a and 3b. Also, the 
angles y/ x and y/ y , defined previously, have the same sign convention as before, with 

positive being in the clockwise. 

In the absence of quad angle error, the constellation is rectangular (square 
if there is no gain imbalance between the I and Q components). The corner angles of a 

15 rectangle are, of course 90 degrees. If there is a quad angle error, the constellation is no 
longer rectangular, and the corner angles are either greater or less than 90 degrees. Let y 
denote the corner angle about the principle diagonal (the diagonal oriented upward to the 
right). The quad angle error *F is the amount by which 7 departs from 90 degrees. Thus, 
y = 90°+ *F . When *F is negative, y< 90°, as in Figure 4a; when is positive, y> 90°, as 

20 in Figure 4b. 

The quad angle error is related to the angles y/ x and y/ y by 
x *=¥>- Wy 

= _ tan ->ik_ tan -'ik (26) 
B B 

xx yy 

25 For the case of negative quad angle error, as shown in Figure 4a, B xy and B yx are both 

positive, so that y/ x is negative, y/ y is positive, and *F is negative. The angles y/ x and y/ y 

are positive in the clockwise direction and negative in the counterclockwise direction. 
For the case of positive quad angle error, as shown in Figure 4b, B xy and B yx are both 



21 



BNSDOCID- <WO 9828888A1 J_> 



WO 98/28888 




PCTYUS97/24194 



negative, so that R is positive, ^ „ negatjve> a „ d y js ^.^ & ^ ^ ^ ^ 

although quad a„ gl e error changes ,he lengths of «he sides and diagonals of the 
co„ S te,la,,o„ pattern, the angle, between ore diagonals remain unchanged. 

In the absence of any quad angle error, 4< = 0, so that Equation (26) leads 
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B xy/B yy - ~B yx I . ^7) 

and (27) m„ , iT*" 1 "° qUad a " 8 ' e ^ "* "° ,0Ck "I"*- CM) 

and (27) must both be s.multaneously satisfied. This can only be possible if B w - B„ - 

0. Ftgu.es 3a, 3b, 4a and 4b show that , hes e conditions lead to an unrotated, undistorted 
rectangular constellation. unoisioneo, 

receiver and "."T"^ " 0t k "° Wn a """" «*" impairment are present in ,he 
rece ver and demodulator, and wha, the mix and relative magnitudes ate of ,he various 

The efore, for the genera, case, i, must be assumed that all types of errors are present, and 
that the magnttudes of all types of errors must be solved for. 

and „ • ■ "I"" 5 iS a " i " US "' ati0,, ° f C ° mbined l0ck ^S' 6 errOT - angle error, 
and gam mtsmatch whtch shows the effect of a quad angle error superimposed upon 
rotated mctangular QPSK consrellation wiUt lock aud gain mismatch errors The x and y 
gams and skews. B m „, derived from the regression analysis of the observed data in the 

const IT V* °'l EqUat '° nS <3) - ' ndiCate Spad " gS ° f * e d — *» distorred 
constellatton. Agatn, the B„, are defined to be positive upward and to the right, so that in 

Ftgure 5 all the B mn except B,„ are positive. The angles a, 8, and £ defined previously 
are again taken to be positive clockwise. S, is the in-phase (I) coordinate cluster spacing 
and S Q ,s the quadrature (Q) coordinate cluster spacing of the distorted constellation D ' 
and D, are ,he lengths of the diagonals, and r a„d 0 are the internal angles, of the 
dtstorted constellation. Although the analysts of Figure 5 is for a QPSK signal, me results 
are agatn applicable to all QAM and QPR constellations of all orders. 

Analysis of Figure 5 leads to the following general expressions for .he 
lock angle error e and the linear gain ralio R : 
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0 = -cos -1 
2 



2AA 



— tan" 



yy v J 



(28) 



where 



*r7 = 



4S 2 Q -{D a -D b y 



{D a + D b f-AS 2 Q 



2 ' 



(29) 



(30) 



(31) 



10 



(32) 



In the general situation, after the coefficients in Equation (3) are 
calculated, the lock angle error is obtained from Equation (28), the gain ratio is obtained 
from Equation (29), and the quad angle error is obtained from Equation (26). Since a 
15 non-zero lock angle error generally indicates a phase misadjustment in the carrier- 
recovery circuit of the receiver demodulator 32, so that the demodulated symbol phases 

are rotated by 6 relative to the transmitted phases, this misadjustment can be corrected by 

sending a command to an adjustable phase shifter (located within the receiver 24) at the 
output of the carrier recovery circuit (located within the receiver 24) to shift the carrier 

20 phase by -6, thereby rotating the entire constellation by -9. Alternatively, the same 
effect could be achieved by shifting the phase of the carrier oscillator in the transmitter 
modulator by -6. This would rotate the constellation into alignment with the symbol 
decision slicing circuitry in the demodulator equally well as by doing it in the carrier 
recovery circuit. 

25 A non-zero quad angle error indicates a phase error in the quadrature 

phase shifter in either the modulator or demodulator, so that the two branches of either 
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the modulator or demodulator are not in phase quadrature, i.e., 90° apart in phase A 
quad angle error of V in the modulator can be corrected by changing the modulator 
quadrature phase shifter by A quad angle error of <F in the demodulator can be 
corrected by either sending a command to the demodulator to change the demodulator 
quadrature phase shifter by an angle of - Vf or by predistorting the transmitted 
constellation by changing the modulator quadrature phase shifter by If quad angle 
errors are present in both the modulator and demodulator with a combined error of V 
then they can be simultaneously corrected by changing the modulator quadrature phase 
shifter by -Y. In general, it cannot be determined which device is responsible for the 
quad angle error without conducting separate special tests on each piece of equipment 
Consequently, it is recommended that all quad angle errors be corrected by rotation of the 
modulator quadrature phase shifter by 

As discussed above, gain imbalances may occur in the modulator 12 prior 
to combining the in-phase and quadrature channels, or in the demodulator 32 after 
separating these channels. Gain imbalance in the modulator 12 can be eliminated by 
providing an adjustable linear amplifier in one of the channels, e.g., the quadrature 
channel, prior to combining, and by varying this gain in the direction to bring the linear 
gain ratio R G to 1. Gain imbalance in the demodulator 32 can be corrected by either 
adjusting the gain of a linear amplifier in one arm of the demodulator 32 to bring R = 1 
or by predistorting the constellation by adjusting a linear amplifier in the modulator^ to' 
bring R G _ 1. since gain imbalances can occur in either or both the modulator 12 and 
demodulator 32, and since the source of the imbalance cannot be determined without 
conducting special tests on each device, it is recommended that all gain imbalances be 
corrected at the modulator 12. 

Since the lock and quad angle errors and the gain imbalance are all due to 
different phenomena, and since all are calculated simultaneously from the constellation 
measurements, the corrections for all effects can be implemented directly and 
simultaneously. All measurements, calculations, and corrective adjustments should be 
repeated .teratively until the angle errors and gain imbalance are made acceptably small 

S.nce all the linear effects addressed by the constellation analysis are 
corrected in the transmitter modulator 12, and since the transmitter high power amplifier 
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18 is likely to be the only source of nonlinearities (unless the forward transmission 
channel 22 includes several repeater stages or a satellite transponder, which insert 
additional nonlinear HP As into the forward transmission channel 32), the control output 
of the parameter processor 28 in Figure 1 can instead be routed to the modulator 12. In 

5 this configuration, compensation for the various errors described above is carried out in 
the modulator 12 instead of the separate adaptive predistorter 16, which is no longer 
necessary. This is shown in Figure 6. 

The procedures described herein can be extended to compensate for 
nonlinear distortions in the total transmission path, including intermediate repeaters and 

10 transponders, by use of a method called constellation decomposition. When amplitude- 
dependent nonlinearities are present, any symmetric constellation may be treated as a set 
of nested QPSK subconstellations, as shown in Figure 7 for a 16-QAM constellation with 
I-Q gain mismatch. The numbers in parentheses in Figure 7 denote the (i,j) coordinates 
of the symbol clusters. The single numbers denote the subconstellations. 

15 For a QPSK constellation, all symbol clusters have the same nominal 

distance from the I axis and from the Q axis. Therefore, since there are only four clusters 
in a QPSK constellation and their coordinates are linearly related (i.e., first order 
relationship), it is not possible to measure amplitude nonlinearities. Each elemental QPSK 
subconstellation (numbered k in Figure 7) may thus be represented by a linear model: 

20 

x' irk = A Xk + E„ t (/' - <f) + (f - d% (33a) 

Equations 33a and 33b correspond to Equation 3, but with only the 
25 constant and first order terms. For a QPSK constellation, d' = 3/2, i' and j' take on values 
in the set { 1,2}, and (i' - d') and (j' - d') take on values in the set {-£,•?}. The coordinates 
(*,V*'^'T*) in the subconste U at i° n °f course correspond to a set of coordinates {x iJ9 y^j in 
the full constellation. For example, for Subconstellation 1, the following associations are 
made (It should be recalled that numbering begins in the lower left corner of the 
30 constellation or subconstellation, the first subscript is the x coordinate or row number, 
and the second subscript is the y coordinate or column number): 
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*mi -*22> (34 a ) 

*2H-*32> ( 34b ) 



and similarly for the y' . 

It should be further noted .hat Figure 5 applies as well to the 
subconstel.ations, with the coefficients B mn replaced by the E m , . Therefore, it is seen 



from Figure 5 that 



«, -*2u -*iu -Jc 2 2t - *i 2 *> (35a) 
*>•, x zik x 2ik- x nk~ x m, (35b) 

- y\ik Ji u- - y 2 2* ~ y 2 \ k • (35d) 



By combining Equations (3), (34) and (35), expressions for the quantities E mn may be 
obtained for each subconstellation using Equations 3. These expressions are 

expressed using the coefficient parameters of Equations 3 to relate the E mn coefficients 
to the coefficient parameters in Equations 3. For example, for subconstellation 1 in 
Figure 7, the following relationship between the coefficient parameters is obtained: 

E **t =B ** + \ D xx- (36) 

The general characteristics of the resulting quantities E m „ k are as follows: 

1The E m „ t are always independent of the constellation biases A x and A 
2 The £„„„ are independent of the second-order coefficients C mn . 
3 -The E mnt depend on the B mn and D mn with the same subscripts m and n. 
4.The x and y components that are based on differences between the - 

P a,r of symbol clusters (e.g., E„ t = ^ _ ^ and ^ = ^ _ ^ ) haye ^ ^ ^ 



same 



26 



BNSDOCID: <WO 9828888A1_I_> 



WO 98/28888 



PCT7US97/24194 



defined: 



Then, by analogy to Equations (30) to (32), the following quantities are 



(37) 



(38) 



(39) 



10 These quantities are used in an extension of Equation (28) to obtain the lock angle error 
6 k for Subconstellation k as 



6. = — cos 
1 2 



2D «Pk 



-tan 



f F +E ^ 



(40) 



15 Also, by analogy with Equation (26), the quad angle error for Subconstellation k is given 
by 



4^-tan" 1 ^— tan- 1 ^ 



(41) 



20 and by analogy with Equation (29), the gain ratio for Subconstellation k is given by 



R r =tan-2*- = 



2 



(42) 



Equations (40), (41) and (42) give, respectively, the lock angle error, quad angle error, 
25 and gain imbalance for each subconstellation for the entire transmission chain, including 
the transmitter, receiver, and all intermediate repeaters and transponders. 
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10 



15 



20 



It should be noted that in this formulation the ideal gain ratio for a 
^onste.lafion depends on its relation ,„ me total constellation. Thus in Figur 7 he 

S ~»«°- I and 2, which are ho,h s q uare, are hoth enuaHo 
while, he .deal ga,„ rat.os for Subeons t e„a.io„ s 3 and 4, which are both rectangular, ar 
the" o ^TT* Si " Ce * e ratio of a symbol depends on its position i 

the constellation, the gain ratio cannot be corrected by adjusting an amplifier gain n Z 
source transmitter modulator since this would apply the same gain to a tra IL d 
symbols. Instead, the I and Q coordinates of each symbol must be scaler, accordin g to 
desired gam ra„o for the snbconstellation, in the adaptive predistorter, to bring the g nr 
ratio o the symbol (which is eouivalen, to the tangent of the vector from me orfgin to 
symbol location) to its ideal value, ^ , where k denotes the particular subconstellation 

ltd C V he k mb °' be,0ngS ' A ' ^ " me ' P ° Si "°" ° f «» — be 

rotated about the ongtn by an angle of -e k to correct for the subconstellation lock angle 

error and associated nonlinear AM-PM convetsion distortion. Similarly, the Q axis of the 
subconstellation to which the symbol belongs must be skewed by an angle of to 
IT" *" "* «-»• Similarly, compensation for lock 

the inZ , k " r0r ^ « » -bconstellation basis since 

ITT SUbC0 " StellMi0 " S ~y «P"ience different lock angle and q uad angle 
errors. This compensate is implemented by th. adaptive predistorter of Figure ! 

Whde the invention has been particularly shown and described with 

»rr ,o a t™ 1 embodimem thereof - " wni bc »> skilled i„ r 

art that various changes in form and details may be made therein without departing from 
the spirit and scope of the invention. g 
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WHAT IS CLAIMED IS: 

1 1. A method for adaptively compensating a digital signal, comprising 

2 the following steps: 

3 accumulating statistical information at a receiver regarding a 

4 received signal transmitted by a transmitter, said accumulating step comprising the 

5 further steps of accumulating symbol cluster statistical information and using said symbol 

6 cluster statistical information to accumulate constellation statistical information; 

7 processing said statistical information to determine compensation 

8 values; and 

9 using said compensation values to compensate said signal. 

1 2. The method of claim 1, wherein said digital signal includes at least 

2 one of QAM (quadrature amplitude modulation), TCM (trellis coded modulation), CAP 

3 (carrierless AM/PM), MPSK (multiple phase shift keying), QPR (quadrature partial 

4 response) and signal constellations. 

1 3. The method of claim 1, wherein said step of accumulating 

2 constellation statistical information and said processing step are used to determine 

3 predistortion parameters, said method comprising the further step of using said 

4 predistortion parameters to predistort said signal prior to transmission of said signal, 

5 whereby said received signal symbol clusters are properly located in accordance with 

6 predetermined signal decision boundaries. 

1 4. The method of claim 1 , further comprising the following steps: 

2 transmitting from said receiver to a transmitter which transmitted 

3 said digital signals received at said receiver, statistical and control information indicative 

4 of the distortions in the received signals; and 
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processing said statistical and control information to determine at 
least one of type, magnitude and direction of compensating predistortions which may be 
applied at the transmitter to predistort said signal prior to its transmission, whereby the 
8 received signal at the receiver will have substantially no distortions. 

1 5. The method of claim 1 , further comprising the following steps: 

determining constellation distortions due to at least one of voltage 

3 offset, gain mismatch ratio, lock angle error, quad angle error, nonlinear channel 

4 distortions and receiver distortions; and 



5 
6 



compensating for said constellation distortions in at least one of the 
in-phase and quadrature signal components of said signal. 



6. The method of claim 5, wherein said compensating step is 
2 performed at one of the transmitter and receiver. 



1 7 

2 

3 

4 signal; and if so, 

5 



The method of claim 1, further comprising the following steps: 
using a memory-based predistorter to compensate said signal; 
determining any residual nonlinear distortion still present in said 



adaptively predistorting said signal to substantially eliminate said 
residual nonlinear distortion. 



8. The method of claim 5, wherein control information indicative of 
said constellation distortions is exchanged between said transmitter and said receiver over 
a narrow bandwidth control channel. 
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1 9. The method of claim 8, wherein parameters in at least one of said 

2 receiver and transmitter are adjusted to correct distortions in said constellation arising 

3 from previously set parameter values. 

1 10. The method of claim 5, wherein the step of determining 

2 constellation distortions due to lock angle error comprises the following steps: 

3 determining at least one of the magnitude and direction of the lock 

4 angle error in the constellation; and 

5 shifting the carrier phase in at least one of the transmitter and 

6 receiver to rotate the constellation in a direction and an amount which reduces the lock 

7 angle error. 

1 11. The method of claim 5, wherein the step of determining 

2 constellation distortions due to quad angle error comprises the following steps: 

3 determining at least one of the magnitude and direction of the quad 

4 angle error; and 

5 adjusting at least one of the modulator quadrature phase shifter in 

6 the transmitter and the demodulator quadrature phase shifter in the receiver in a direction 

7 and an amount to reduce the quad angle error. 

1 12. The method of claim 5, wherein the step of determining 

2 constellation distortions due to voltage offset comprises the following steps: 

3 determining the magnitude of the voltage offset; and 

4 adjusting the bias voltage in at least one of the transmitter and 

5 receiver in a direction and an amount to reduce the voltage offset. 

1 13. The method of claim 5, wherein the step of determining 

2 constellation distortions due to gain mismatch ratio comprises the following steps: 
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determining the magnitude of the gain mismatch ratio; and 
adjusting the amplifier gains in at least one of the transmitter and 
rece,ver in a direction and an amount to reduce the gain mismatch ratio. 

14- The method of claim 5, wherein the step of determining 
constellation distorts due to nonlinear channel distortion comprises the following 
steps: & 

determining the magnitude of the nonlinear channel distortion; and 
adjusting the position of each symbol within the constellation in at 

least one of the transmitter and receiver in a direction and an amount to reduce the 

nonlinear channel distortion. 

1 5. The method of claim 5, wherein the step of accumulating statistical 
information comprises the following steps: 

accumulating weighted sums of the symbol coordinates to produce 
first, second and third matrices; 

inverting said first matrix and multiplying said inverted first matrix 
by said second matrix to produce a first coefficient matrix of the coefficients for a first 
coordinate of the constellation used in a least squares mode, for estimating the center of 
each symbol cluster; 

multiplying said inverted first matrix by said third matrix to 
produee a seeond eoeffieien, matrix of the eoeffieients for a seeond coordinate of the 
cons.efia.ion nsed in said leas, squares model for estimating the center of each symbol 
cluster. 
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1 16. The method of claim 15, wherein said first and second coordinates 

2 are the x and y cartesian coordinate dimensions of said symbol clusters, respectively. 

1 17. The method of claim 15, wherein the step of accumulating 

2 weighted sums is performed in accordance with the following relationships to produce 

3 said first, second and third matrices, designated A, B x and B y : 
4 
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14 















p 




m ikyi ik 








i - 


=" j=l k=l 

















wherein . is defined a, (/- V 2) and „ is defined as (/-W +I /2)), v is .he number of 
symbols ,„ each coordinate of me consteliation and , and; arc integers ranging from , ,„ 
M which indicate the location of each cluster. 



1 

2 
3 

4 

5 

6 
7 

8 

9 

10 

11 

12 

13 

14 

15 
16 



18. The method of claim 17, wherein said first and second coordinate 
coefficient matrices are of the form: 



P x=K B y C 



xv C D 

xx xy j 



c 

y* yy 



wherein A x and A y are constellation offsets in the * and y directions, respectively, B and 
B„ are the linear gains in the , and y directions, respectively, B v is the linear run peTunit 
nse, B yx is the linear rise per unit run, Cjcx , Cyy , Dxx and D„ are the nonlinear gains in the * 
and y directions, respectively, C v D v and are the nonlinear skews in the , and y 
chrect.ons respectively, and wherein said coefficients A, B, C and D are used in a higher 
order least squares model of the estimated cluster center locations of the following form: 

h = \ + B xx (i - d) + B xy ( j - d) + C xx (i - d) 2 + C xy ( j - d) 2 + Dxx (i -d) 3 + D xy (j - d )\ 
= ^ + B yx (i - d) + Byy (j - d) + C yx (i - d) 2 + C yy ( j - d) 2 + D yx (i - d ) 3 + D J(j - d) 1 
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1 19. The method of claim 18, wherein said gain mismatch ratio R c is 

2 defined as the following ratio BJB yy . 

1 20. The method of claim 18, wherein said second and third order gain 

2 mismatch ratios R G2 and R G3 are defined as the following ratios, respectively, CJC yy and 

3 DjDyy. 

1 21. The method of claim 18, wherein said lock angle error is 

2 determined in accordance with the following relationship: 



3 



-5 



^an-'^-tan-'l^ 



1 22. The method of claim 18, wherein said quad angle error is 

2 determined in accordance with the following relationship: 

3 

-i Byx + -i Bxy 

= -tan q ~ tan — L 

4 Byy 

1 23. The method of claim 18, wherein the coefficient parameters are 

2 used to define the following quantities: 



S q = V B yy + B x 2 y 
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24. The method of claim 23, wherein lock angle error is determined in 
accordance with the following relationship: 



e = - cos - 1 

2 



^+D b 2 -4S£ 
2D a D b . 



- tan" 



J 



25. The method of claim 23, wherein the gain mismatch ratio is 
determined m accordance with the following relationship: 



1^JS^> 
KD a + D b ) 2 -4 



► 2 



26. An adaptive memory based predistorter for use in a digital 
transmission system, comprising: 

at least one amplifier having an operating range including at least 
4 one nonlinear region; 

a predistorter circuit for compensating a signal to be transmitted 
pnor to transmission thereof in an amount substantially equal and opposite to a distortion 
of sa ld signal caused by said at least one nonlinear region of said at least one amplifier; 

an adaptation circuit for repeatedly determining updated 
characterises of said at least one nonlinear region of said at least one amplifier in 
response to changes of at least one of temperature, voltage, power, and time; 

an update circuit for updating said predistorter circuit with said 
updated characteristics of said at least one amplifier in response to a test sequence 
13 transmitted by said at least one amplifier 



2 performed in a repeater circuit. 



27. The method of claims 1, 5, and 18, wherein said method is 



36 



<WO 9828888A1J_> 



WO 98/28888 




PCT/US97/24194 



1 28. The method of claim 15, wherein said processing step is performed 

2 at one of said transmitter and receiver. 

1 29. The method of claim 15, wherein compensating step is performed 

2 at one of said transmitter and receiver. 

1 30. A method for adaptively compensating a digital signal which is 

2 being transmitted by a transmitter and received by a receiver, comprising the following 

3 steps: 

4 modulating a digital signal at the transmitter according to a 

5 predetermined modulation scheme; 

6 adaptively compensating said modulated signal at said transmitter 

7 in accordance with compensation values determined from statistical information 

8 accumulated at the receiver regarding the received signal; 

9 transmitting said compensated modulated signal to said receiver; 

10 receiving said compensated modulated signal at said receiver; 

1 1 accumulating statistical information at said receiver regarding said 

12 received signal, said accumulating step comprising the further steps of 

13 accumulating symbol cluster statistical information and 

14 using said symbol cluster statistical information to accumulate constellation statistical 

1 5 information, 

16 accumulating weighted sums of the symbol coordinates to 

17 produce first, second and third matrices; 

18 inverting said first matrix and multiplying said inverted 

19 first matrix by said second matrix to produce a first coefficient matrix of the coefficients 

20 for a first coordinate of the constellation used in a least squares model for estimating the 

21 center of each symbol cluster, 
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22 
23 



multiplying said inverted first matrix by said third matrix to 
produce a second coefficient matrix of the coefficients for a second coordinate of the 

24 constellauon used in said least squares model for estimating the center of each symbol 

25 cluster; 



26 
27 
28 



processing said statistical information to determine compensation 
vaiues for cons.eHa.ion distortions, dne ,o a, leas, one of voltage offse., gain mismatch 
rano, lock angle etror, quad angle error, non.inear chamte! distortions and receiver 
29 distortions; 

wherein said adaptive compensation step compensates for said 
constellation dtstortions in a, .eas, one of the in-phase and quadrature signai components 
32 of said signal. 



30 
31 



31. The method of claim 30, wherein said receiver transmits said 

2 statistical information over a reverse mnt™i r*u~ i < 

reverse control channel to said transmitter and said 



3 
1 

2 



} 

2 
1 

2 
3 
4 



processing step is performed at said transmitter. 



32. The method of claim 30, wherein said processing step is performed 
a. S a,d receiver and said receiver transmit said compensation values to said transmitter 
over a reverse control channel. 



33. The method of claim 30, further comprising the step of 
compensating said modulated signals using a memory-based predistorter. 

34. The method of claim 30, wherein said digital signal is part of a 
.gnal constellation, and said method further comprises the steps of partitioning said 
signal constellation into a plurality of sub-constellations and performing said 
accumulating and processing steps for the signals within each sub-constellation 
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1 35. A method for adaptively compensating a digital signal which is 

2 being transmitted by a transmitter and received by a receiver, comprising the following 

3 steps: 

4 modulating a digital signal at the transmitter according to a 

5 predetermined modulation scheme; 

6 adaptively compensating said modulated signal at said receiver in 

7 accordance with compensation values determined from statistical information 

8 accumulated at the receiver regarding the received signal; 

9 transmitting said modulated signal to said receiver; 

10 receiving said modulated signal at said receiver; 

1 1 accumulating statistical information at said receiver regarding said 

12 received signal, said accumulating step comprising the further steps of 

13 accumulating symbol cluster statistical information and 

14 using said symbol cluster statistical information to accumulate constellation statistical 

15 information, 

16 accumulating weighted sums of the symbol coordinates to 

17 produce first, second and third matrices; 

18 inverting said first matrix and multiplying said inverted 

19 first matrix by said second matrix to produce a first coefficient matrix of the coefficients 

20 for a first coordinate of the constellation used in a least squares model for estimating the 

21 center of each symbol cluster; 

22 multiplying said inverted first matrix by said third matrix to 

23 produce a second coefficient matrix of the coefficients for a second coordinate of the 

24 constellation used in said least squares model for estimating the center of each symbol 

25 cluster; 

26 processing said statistical information to determine compensation 

27 values for constellation distortions due to at least one of voltage offset, gain mismatch 
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28 ratio, lock angle error, quad angle error, nonlinear channel distortions and receiver 

29 distortions; 

30 Wherein said ada P tive compensation step compensates for said 
3. constellation distortions in at least one of the in- P hase and quadrature signal components 
32 of said signal. 

1 36. The method of claim 35, wherein said receiver transmits said 

2 statistical information over a reverse control channel to said transmitter, said processing 

3 step is performed at said transmitter and said transmitter transmits compensation values 

4 to said receiver over a forward control channel.. 

1 37. The method of claim 35, wherein said processing step is performed 

2 at said receiver. 

1 38. The method of claim 35, further comprising the step of 

2 compensating said modulated signals using a memory-based predistorter. 

s 39. The method of claim 35, wherein said digital signal is part of a 

2 signal constellation, and said method further comprises the steps of partitioning said 



signal constellation into a plurality of sub-constellations and performing said 
accumulating and processing steps for the signals within each sub-constellation. 



40. An adaptive compensation system for compensating a digital 
2 signal, comprising: 

a statistical accumulation circuit which accumulates statistical 
information at a receiver regarding a received signal transmitted by a transmitter, said 
accumulation involving the accumulation of symb ol Custer statistical information which 
is used to accumulate constellation statistical information; 
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7 a compensation value determination circuit which processes said 

8 statistical information to determine compensation values; and 

9 a compensation circuit which uses said compensation values to 

10 compensate said signal. 

1 41. The system of claim 40, further comprising: 

2 a constellation distortion estimation circuit which determines the 

3 constellation distortions due to at least one of voltage offset, gain mismatch ratio, lock 

4 angle error, quad angle error, nonlinear channel distortions and receiver distortions; and 

5 wherein said compensation circuit compensates for said 

6 constellation distortions in at least one of the in-phase and quadrature signal components 

7 of said signal. 

1 42. The system of claim 41, wherein said statistical accumulation 

2 circuit further comprises: 

3 a weighted sum circuit which accumulates weighted sums of the 

4 symbol coordinates to produce first, second and third matrices; 

5 a matrix inversion circuit which inverts said first matrix and 

6 multiplies said inverted first matrix by said second matrix to produce a first coefficient 

7 matrix of the coefficients for a first coordinate of the constellation used in a least squares 

8 model for estimating the center of each symbol cluster; and 

9 a multiplication circuit which multiplies said inverted first matrix 

10 by said third matrix to produce a second coefficient matrix of the coefficients for a second 

1 1 coordinate of the constellation used in said least squares model for estimating the center 

12 of each symbol cluster. 
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43. The system of claim 42, wherein weighted sum circuit operates to 
produce sa,d first, second and third matrices, designated A, B x and B y in accordance with 
the following relationships: 
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12 wherein 1 is defined as (/- (M+l)/2) and m is defined as (j-(M+M2)\ M is the number of 

13 symbols in each coordinate of the constellation and /' andy are integers ranging from 1 to 

14 M which indicate the location of each cluster. 

1 44. The system of claim 43, wherein said first and second coordinate 

2 coefficient matrices are of the form: 

3 

4 P x=K B xx B xy C xx C xy D xx Dj, 

5 PJ=|a Byy D,, Dj 

6 

7 wherein A x and A y are constellation offsets in the x and y directions, respectively, B xx and 

8 are the linear gains in the x and y directions, respectively, is the linear run per unit 

9 rise, B yx is the linear rise per unit run, C w and D yy are the nonlinear gains in the x 

10 and y directions, respectively, C^, and D yx are the nonlinear skews in the x and y 

1 1 directions respectively, and wherein said coefficients A, B, C and D are used in a higher 

12 order least squares model of the estimated cluster center locations of the following form: 
13 

14 5y = Ac + BJ) - d) + tV j - d) + C xx (i - d) 2 + C xy ( j - d) 2 + D xx (i - d) 3 + D^j - d) 3 , 

15 y„ = A + B^i - d) + B^(j - d) + C yx (i - d) 2 + C yy (j - d) 2 + D yx (i - d) 3 + D^j - d) 3 

1 45. A system for adaptively compensating a digital signal which is 

2 being transmitted by a transmitter and received by a receiver, comprising: 

3 a signal modulator which modulates a digital signal at the 

4 transmitter according to a predetermined modulation scheme; 

5 an adaptive compensation circuit which compensates said 

6 modulated signal at said transmitter in accordance with compensation values determined 

7 from statistical information accumulated at the receiver regarding the received signal; 
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a transmitter for transmitting said compensated modulated signal to 
a receiving circuit which receives said compensated modulated 



8 

9 said receiver; 
10 

1 1 signal at said receiver; 

a statistical accumulation circuit which accumulates statistical 



information at said receiver regarding said received signal, said statistical accumulation 

14 circuit comprising 

15 a symbol cluster accumulation circuit which accumulates 

16 symbol cluster statistical information and uses said symbol cluster statistical information 

17 to accumulate constellation statistical information, 

a weighted sum circuit which accumulates weighted sums 
of the symbol coordinates to produce first, second and third matrices; 

an inversion circuit which inverts said first matrix and 
multiplies said inverted first matrix by said second matrix to produce a first coefficient 
matrix of the coefficients for a first coordinate of the constellation used in a least squares 
23 model for estimating the center of each symbol cluster; 

a multiplication circuit which multiplies said inverted first 
matrix by said third matrix to produce a second coefficient matrix of the coefficients for a 
second coordinate of the constellation used in said least squares model for estimating the 
27 center of each symbol cluster; 

a processing circuit which processes said statistical information to 
determine compensation values for constellation distortions due to at least one of voltage 
offset, gain mismatch ratio, lock angle error, quad angle error, nonlinear channel 

3 1 distortions and receiver distortions; 

32 wherein said adaptive compensation circuit compensates for said 

33 constellation distortions in at least one of the in-phase and quadrature signal components 

34 of said signal. 
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1 46. The system of claim 45, wherein said receiver transmits said 

2 statistical information over a reverse control channel to said transmitter and said 

3 processing circuit is located at said transmitter. 

1 47. The system of claim 45, wherein said processing circuit is located 

2 at said receiver and said receiver transmits said compensation values to said transmitter 

3 over a reverse control channel. 

1 48. The system of claim 45, further comprising a memory -based 

2 predistorter for predistorting said modulated signal prior to transmission. 

1 49. The system of claim 45, wherein said digital signal is part of a 

2 signal constellation, and said system further comprises a partitioning circuit which 

3 partitions said signal constellation into a plurality of sub-constellations which are 

4 processed by said accumulation and processing circuits for the signals within each sub- 

5 constellation. 

1 50. A system for adaptively compensating a digital signal which is 

2 being transmitted by a transmitter and received by a receiver, comprising: 

3 a signal modulator which modulates a digital signal at the 

4 transmitter according to a predetermined modulation scheme; 

5 an adaptive compensation circuit which adaptively compensates 

6 said modulated signal at said receiver in accordance with compensation values 

7 determined from statistical information accumulated at the receiver regarding the 

8 received signal; 

9 a transmitter for transmitting said modulated signal to said 

10 receiver; 
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11 



a receiving circuit which receives said modulated signal at said 
12 receiver; 



13 

14 



17 



20 
21 

22 
23 
24 
25 
26 
27 



30 
31 



1 

2 



a statistical accumulation circuit which accumulates statistical 
information at said receiver regarding said received signal, said statistical accumulation 



1 5 circuit comprising: 
16 



a symbol cluster accumulation circuit which accumulates 
symbol cluster statistical information and uses said symbol cluster statistical information 

1 8 to accumulate constellation statistical information, 

19 a weighted sum circuit which accumulates weighted sums 
of the symbol coordinates to produce first, second and third matrices; 

an inversion circuit which inverts said first matrix and 
multiplying said inverted first matrix by said second matrix to produce a first coefficient 
matrix of the coefficients for a first coordinate of the constellation used in a least squares 
model for estimating the center of each symbol cluster; 

a multiplication circuit which multiplies said inverted first 
matrix by said third matrix to produce a second coefficient matrix of the coefficients for a 
second coordinate of the constellation used in said least squares model for estimating the 

28 center of each symbol cluster; 

29 • 

a processing circuit which processes said statistical information to 

determine compensation values for constellation distortions due to at least one of voltage 
offset, gain mismatch ratio, lock angle error, quad angle error, nonlinear channel 
32 distortions and receiver distortions; 

wherein said adaptive compensation circuit compensates for said 

34 constellation distortions in at least one of the in-phase and quadrature signal components 

35 of said signal. 



51. The system of claim 50, wherein said receiver transmits said 
statistical information over a reverse control channel to said transmitter, said processing 
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3 circuit is located at said transmitter and said transmitter transmits compensation values to 

4 said receiver over a forward control channel. 

1 52. The system of claim 50, wherein said processing circuit is located 

2 at said receiver. 
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1 53. The system of elaim 50, further comprising a memory-based 

2 predistorter for predicting said modnlated signal prior to transmission. 

' 54. The system of elaim 50, wherein said digital signal is part of a 

2 stgnal constellation, and satd system further comprises a partitioning circuit which 



partitions said signal constellation into a plurality of sub-constellations which are 
processed by said accumulation and processing circuits for the signals within each sub- 



3 
4 

5 constellation 
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